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DETAILED ACTION 
Claim Rejections - 35 USC § 102 

* • 

1 . The following is a quotation of the appropriate paragraphs of 35 U.S.C. 1 02 that 
form the basis for the rejections under this section made in this Office action: 

A person shall be entitled to a patent unless - 

(b) the invention was patented or described in a printed publication in this or a foreign country or in public 
use or on sale in this country, more than one year prior to the date of application for patent in the United 
States. 

2. Claim 1,6,17-24, 27,28,31-33 and 35-39 are rejected under 35 U.S.C. 102(b) as 

being anticipated by Wink Communications ( http://web.archive.org/web/20001206040800/wink.com/ ). 

As to independent claim 1 , Wink teaches a method of retrieving information 
associated with an object present in a media stream (E Page 3), said method 
comprising the steps of: defining a user-selectable region in a layer separate from the 
media stream (E Page 6; Wink Studio) without accessing individual frames of the media 
stream (E Page 6, figures 1 and 2; in figure 1 the white-box in the development window 
is the space allotted for the media stream, while the graphics located in at the bottom of 
the development window are context and defined user-selectable regions whom which 
are present during the set duration of time of the media stream. Those skilled in the art 
will appreciate the fact that adding a set graphical area below/on top of the media 
stream will result in not having to access every frame individually for creation/edit 
purposes by the operator.) 
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Wink teaches the user- selectable region corresponding to the object present in 
the media stream (E Page 1 1 ; User is selecting object to order a video); defining a link 
to the information associated with the object (E Page 6, Wink Studio); linking the user- 
selectable region in the layer to the link for the information associated with the object (E 
Page 6; Wink Studio); positioning the user-selectable region in the layer over the object 
during playback of the media stream (E Page 6 and 1 1 ; Those skilled in the art will 
appreciate that a user selectable area created by the developer to be placed on top of 
the media stream has an clickable/responsive area associated with said user selectable 
area also known as a hotspot); disposing the layer adjacent the media stream without 
interfering with playback of the media stream (E Page 2, par. 2 and E Page 1 1 , fig.2; 
where the interactive content is displayed overtop of the media making it adjacent); 
playing the media stream in the player (E Page 10,Wink Engines (set-top box is making 
use of Wink protocols (E Page 5) to play media); playing the media stream in a player 
(Col. 3, lines 9-10); selecting the user-selectable region from within the layer during 
playback of the media (E Page 6 and E Page 11,fig.1); and accessing the information 
associated with the object in response to selecting the user-selectable region from 
within the layer (E Page 1, par. 2; selecting object will provide user with associated data 
and E Page 3). 

As to independent claim 20, Wink teaches a method of providing a video signal 
from a provider to a user (E Page 10, Figure Diagram), said method comprising the 
steps of: transmitting a first component of the video signal having a media steam therein 
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(E Page 10, Wink Broadcast Server and Data Insertion); transmitting a second 
component of the video signal having a layer with user-selectable regions 
corresponding to objects present in the media stream and linked to information 
associated with the object (E Page 10, Wink Broadcast Server and Data Insertion); 
receiving the video signal with a player (E Page 10, Wink Engines (which is in a cable 
box designed to handle Wink application); disposing the layer adjacent the media 
stream without interfering with playback of the media stream (E Page 2, par. 2 and E 
Page 1 1 , fig. 2; where the interactive content is displayed overtop of the media making it 
adjacent); playing the media stream in the player (E Page 10,Wink Engines (set-top box 
is making use of Wink protocols (E Page 5) to play media); positioning the user- 
selectable regions within the layer to the objects present in the media stream during 
playback (E Page 6, Operator is able to position interactive regions for the user within 
the creation studio's current form); and enabling the user-selectable region to allow the 
user to select the user-selectable regions and access the informant associated with the 
object (E Page 6 and E Page 1 1 ,fig.1 ). 

As to independent claim 24, Wink teaches a device for storing information 
associated with an object present in a media stream (E Page 10; Video Integration, 
where Networks add Wink into there broadcastings, it is at this location where their 
computers are storing information of interactive objects in media stream), said device 
comprising: a media stream with an object therein (E Page 3); information associate 
with said object (E Page 3); a layer for disposition adjacent said media stream during 
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playback and having a user-selectable region corresponding to said object in said 
media stream (E Page 2, par. 2 and E Page 1 1, fig.2; where the interactive content is 
displayed overtop of the media making it adjacent); and a link between said user- 
selectable region and said information associated with said object for accessing said 
information associated with said object in response to said user-selectable region being 
selected (E Page 2 and E Page 12). 

As to independent claim 35, Wink teaches a system capable of storing (Wink 
Software and Video Integration) and retrieving (Response Network) information 
associated with an object present in a media stream provided with a video signal from a 
provider (E Page 10), said system comprising: an editor defining a user-selectable 
region corresponding to the object in the media stream without accessing individual 
frames of the media stream and defining a link between said user-selectable region and 
information associated with said object (E Page 6, figures 1 and 2; in figure 1 the white- 
box in the development window is the space allotted for the media stream, while the 
graphics located in at the bottom of the development window are context and defined 
user-selectable regions whom which are present during the set duration of time of the 
media stream. Those skilled in the art will appreciate the fact that adding a set graphical 
area below/on top of the media stream will result in not having to access every frame 
individually for creation/edit purposes by the operator.); 
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Wink teaches a player device for playing the media stream with the object therein 
(E Page 2, par. 2); and a layer disposed adjacent the media stream during playback and 
presenting the user-selectable region for selection by the user to access the information 
(E Page 2, par. 2 and E Page 1 1 , fig.2; where the interactive content is displayed 
overtop of the media making it adjacent); playing the media stream in the player (E 
Page 10,Wink Engines (set-top box is making use of Wink protocols (E Page 5) to play 
media); 

As to dependent claim 6, Wink teaches a method as set forth in claim 1, further 
including the step of displaying an icon that represents a user-selectable region present 
in the layer capable of being selected (E Page 1, paragraph 2 and E Page 3). 

As to dependent claim 17, Wink teaches a method as set forth in claim 1, further 
including the step of establishing two-way communication between a user interacting 
with the layer and a provider transmitting a video signal having the media stream and 
the layer (E Page 3 and 1 1 ). 

As to dependent claim 18, Wink teaches a method as set forth in claim 17, 
further including the step of collecting user data related to selection of links made during 
playback of the media stream present therein (E Page 9, paragraph 1). 
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As to dependent claim 19, Wink teaches a method as set forth in claim 18, 
further including the step of transmitting the user data to the provider to track the links 
selected from within the layer (E Page 9, paragraphs 2 and 4). 

As to dependent claim 21, Wink teaches a method as set forth in claim 20, 
further including the step of establishing two-way communication between the user 
interacting with the layer and the provider transmitting the video signal (E Page 9, par. 

1). 

As to dependent claim 22, Wink teaches a method as set forth in claim 21 , 
further including the step of collecting user data related to selection of links made during 
playback of the media stream (E Page 9, par. 2). 

As to dependent claim 23, Wink teaches a method as set forth in claim 22, 
further including the step of transmitting the user data to the provider to track the links 
selected from within the layer (E Page 9, par. 4). 

As dependent claim 27, Wink teaches a device as set forth in claim 24, further 
including an icon disposed in said layer in response to said user-selectable region being 
present in said layer (E Page 1 , par. 2). 
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As to dependent claim 28, Wink teaches a device as set forth in claim 24, further 
including a detector (program) for monitoring and detecting an identifying characteristic 

i 

for the object with said layer, whereas Murray does (Col. 2, lines 55-63). 

As to dependent claim 31 , Wink teaches a device as set forth in claim 24, further 
including a window for displaying information associated with the object (E Page 3 and 
11). 

As to dependent claim 32, Wink teaches a device as set forth in claim 31 , 
wherein said window is further defined as being displayed in said layer (Wink Studio 
and Video Integration E Page 6 and 10; wherein the studio the operator creates the 
wink application, seen in figure 1 depicted a layer for video broadcasting and a layer for 
information.) 

As to dependent claim 33, Wink teaches a device as set forth in claim 32, 
wherein said window is further defined as being displayed in said media stream (E Page 
10). 

As to dependent claim 36, a system as set forth in claim 35, wherein the layer is 
further defined as being transmitted as a component of the video signal (E Page 10; 
wherein the figure shows the flow of data/signals from the video integration to the wink 
engines). 
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As to dependent claim 37, a system as set forth in claim 35, wherein the layer 
disposed adjacent the media stream is further defined as being disposed adjacent the 
media stream without interfering with playback of the media stream (E Page 2, par. 2 
and E Page 1 1 , fig. 2; where the interactive content is displayed overtop of the media 
making it adjacent); playing the media stream in the player (E Page 10,Wink Engines 
(set-top box is making use of Wink protocols (E Page 5) to play media). 

As to dependent claim 38, a system as set forth in claim 35, further including a 
plurality of user-selectable regions in said layer corresponding to a plurality of objects (E 
Page 12, fig. 1). 

As to dependent claim 39, a system as set forth in claim 35, further including an 
icon disposed in said layer in response to said user-selectable region being present in 
said layer (E Page 1 , par. 2). 

Claim Rejections - 35 USC § 103 

3. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 
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4. Claims 2-5,7-13,15,16,25,26,29,30 are rejected under 35 U.S.C. 103(a) as being 

unpatentable over Wink Communications 

( http://web.archive.Org/web/19991012081750/http://wink.com/ ) in view of Bove et al (Adding Hyperlinks to 
Digital Television). 

Note: Wink and Bove provide systems, methods and teachings of interactive TV, 
where as the developers have an authoring tool/editor to add interactive content to the 
media stream to which will be broadcasted to the end-user. They both teach about user 
selectable objects upon which Bove goes into further depth of explaining how to track 
objects movements throughout a media stream and updating it accordingly with a link 
associated with present object's defined area/hotspot. It is appreciated by those skilled 
in the art that these two teachings are related by purposes set forth by a media stream 
having interactive hyperlinks associated with onscreen objects (graphical and video 
alike). 

As to dependent claim 2, Wink fails to teach a method as set forth in claim 1 
wherein the step of defining the user-seiectable region is further defined as the step of 
defining positional data for the object based upon a position and size of the object 
present in the media stream, whereas Bove does teach (Page 3, par. 4-5) It is obvious 
to one of ordinary skill in the art at the time of the invention to have used the teachings 
of Wink into the teachings of Bove, because they solve the same problem of providing 
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interactive TV with hyperlinked data in a media stream presented in a graphical overlay 
(Page 2, par. 1 ). 

As to dependent claim 3, Wink fails to teach a method as set forth in claim 1 , 
further including the step of redefining the user-selectable region within the layer in 
response to the object changing within the media stream, whereas Bove does teach 
(Page 3, par. 5 and Page 4, par. 2). It is obvious to one of ordinary skill in the art at the 
time of the invention to have used the teachings of Wink into the teachings of Bove, 
because they solve the same problem of providing interactive TV with hyperlinked data 
in a media stream presented in a graphical overlay (Page 2, par. 1). 

As to dependent claim 4, Wink fails to teach a method as set forth in claim 1 , 
wherein the step of defining the user-selectable region further includes the step of 
defining a plurality of user-selectable regions for the object in response to the object 
being present in a plurality of positions in the media stream whereas Bove does teach 
(Page 3, par. 5 and Page 4, par. 2). It is obvious to one of ordinary skill in the art at the 
time of the invention to have used the teachings of Wink into the teachings of Bove, 
because they solve the same problem of providing interactive TV with hyperlinked data 
in a media stream presented in a graphical overlay (Page 2, par. 1). 

As to dependent claim 5, Wink fails to teach a method as set forth in claim 
1 , wherein the step of positioning the user-selectable region is further defined as 
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synchronizing the user-selectable region within the layer to a position of the object in the 
media, whereas Bove does teach (Page 3, par. 3-4), Wink teaches without accessing 
individual frames of the media stream (E Page 6, figures 1 and 2; in figure 1 the white- 
box in the development window is the space allotted for the media stream, while the 
graphics located in at the bottom of the development window are context and defined 
user-selectable regions whom which are present during the set duration of time of the 
media stream. Those skilled in the art will appreciate the fact that adding a set graphical 
area below/on top of the media stream will result in not having to access every frame 
individually for creation/edit purposes by the operator. Also Bove teaches without 
accessing individual frames (Page. 3, par.4). It is obvious to one of ordinary skill in the 
art at the time of the invention to have used the teachings of Wink into the teachings of 
Bove, because they solve the same problem of providing interactive TV with hyperlinked 
data in a media stream presented in a graphical overlay (Page 2, par. 1). 

As to dependent claim 7, Wink fails to teach a method as set forth in claim 1 , 
further including the step of monitoring an identifying characteristic for the object in the 
media stream, whereas Bove does teach (Page 3, par. 4). It is obvious to one of 
ordinary skill in the art at the time of the invention to have used the teachings of Wink 
into the teachings of Bove, because they solve the same problem of providing 
interactive TV with hyperlinked data in a media stream presented in a graphical overlay 
(Page 2, par. 1). 



I 
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As to dependent claim 8, Wink fails to teach a method as set forth in claim 
1 , wherein the step of monitoring the identifying characteristic is further defined as 
monitoring the media stream for a predetermined color palette, whereas Bove does 
teach (Page 3, par.6; collection of pixel's each having a set color defines an object 
which in turns makes up the color palette). It is obvious to one of ordinary skill in the art 
at the time of the invention to have used the teachings of Wink into the teachings of 
Bove, because they solve the same problem of providing interactive TV with hyperlinked 
data in a media stream presented in a graphical overlay (Page 2, par. 1). 

As to dependent claim 9, Wink fails to teach a method as set forth in claim 7, 
wherein the step of monitoring the identifying characteristic is further defined as 
monitoring the media stream for a predetermined symbol, whereas Bove does teach 
(Page 4, par.6). It is obvious to one of ordinary skill in the art at the time of the invention 
to have used the teachings of Wink into the teachings of Bove, because they solve the 
same problem of providing interactive TV with hyperlinked data in a media stream 
presented in a graphical overlay (Page 2, par. 1). 

As to dependent claim 10, Wink fails to teach a method as set forth in claim 7, 
further including the step of detecting a change in the identifying characteristic and re- 
defining the user-selectable region within the layer in response to detecting the change 
of the identifying characteristic, whereas Bove does teach (Page 3, last par. and Page 
4, first par.). It is obvious to one of ordinary skill in the art at the time of the invention to 
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have used the teachings of Wink into the teachings of Bove, because they solve the 
same problem of providing interactive TV with hyperlinked data in a media stream 
presented in a graphical overlay (Page 2, par. 1). 

As to dependent claim 1 1 , Wink fails to teach a method as set forth in 
claim 10,wherein the step of detecting the change in the identifying characteristic is 
further defined as automatically detecting the change in the identifying characteristic for 
the object during playback of the media stream, whereas Bove does teach (Page 3, last 
par. and Page 4, first par.). It is obvious to one of ordinary skill in the art at the time of 
the invention to have used the teachings of Wink into the teachings of Bove, because 
they solve the same problem of providing interactive TV with hyperlinked data in a 
media stream presented in a graphical overlay (Page 2, par. 1). 

As to dependent claim 12, Wink fails to teaches a method as set forth in 
claim 1 1, wherein the step of redefining the user-selectable region is further defined as 
automatically re-defining the user-selectable region within the layer in response to 
automatically detecting the change in the identifying characteristic for the object, 
whereas Bove does teach (Page 3, last par. and Page 4, first par.). It is obvious to one 
of ordinary skill in the art at the time of the invention to have used the teachings of Wink 
into the teachings of Bove, because they solve the same problem of providing 
interactive TV with hyperlinked data in a media stream presented in a graphical overlay 
(Page 2, par. 1). 
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As to dependent claim 13, Wink fails to teach a method as set forth in 
claim 1 , further including the step-stopping playback of the media stream in response to 
selecting the user-selectable region from within the layer, whereas Bove does teach 
(Page 7, par. 2). It is obvious to one of ordinary skill in the art at the time of the invention 
to have used the teachings of Wink into the teachings of Bove, because they solve the 
same problem of providing interactive TV with hyperlinked data in a media stream 
presented in a graphical overlay (Page 2, par. 1). 

As to dependent claim 1 5, Wink fails to teach a method as set forth in 
claim 1, further including the step of continuing playback of the media stream in 
response to selecting the user-selectable region from within the layer, whereas Bove 
does teach (Page 7, par. 1 and 2). It is obvious to one of ordinary skill in the art at the 
time of the invention to have used the teachings of Wink into the teachings of Bove, 
because they solve the same problem of providing interactive TV with hyperlinked data 
in a media stream presented in a graphical overlay (Page 2, par. 1). 

As to dependent claim 16, Wink fails to teach a method as set forth in 
claim 15, further including the step of displaying the object information in at least one of 
the layer and a window separate from the layer while the playback of the media stream 
continues in the player, whereas Bove does teach (Page 4, par. 6; One of ordinary skill 
would appreciate that clicking on a an object relates to an action being performed from 
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the user and said action pulling up information from a URL on the World Wide Web and 
then having said information rendered to the screen that this information can be 
displayed in a native browser/window separate from the media stream). It is obvious to 
one of ordinary skill in the art at the time of the invention to have used the teachings of 
Wink into the teachings of Bove, because they solve the same problem of providing 
interactive TV with hyperlinked data in a media stream presented in a graphical overlay 
(Page 2, par. 1). 

As to dependent claim 25, Wink fails to teach a device as set forth in claim 24, 
further including positional information defined for said user-selectable region based 
upon a position and size of said object present in said media stream, whereas Bove 
does teach (Page 3, par. 4-5). It is obvious to one of ordinary skill in the art at the time 
of the invention to have used the teachings of Wink into the teachings of Bove, because 
they solve the same problem of providing interactive TV with hyperlinked data in a 
media stream presented in a graphical overlay (Page 2, par. 1). 

As to dependent claim 26, Wink fails to teach a device as set forth in clam 25, 
further including a plurality of user-selectable regions in said layer corresponding to a 
plurality of objects, whereas Bove does teach (Page 3, par. 5). It is obvious to one of 
ordinary skill in the art at the time of the invention to have used the teachings of Wink 
into the teachings of Bove, because they solve the same problem of providing 



Application/Control Number: 10/605,684 Page 17 

Art Unit: 2193 

i 

interactive TV with hyperlinked data in a media stream presented in a graphical overlay 
(Page 2, par. 1). 

As to dependent claim 29, Wink fails to teach a device as set forth in claim 28, 
wherein said detector is further defined as detecting a color palette, whereas Bove does 
teach (Page 3, par. 4-5). It is obvious to one of ordinary skill in the art at the time of the 
invention to have used the teachings of Wink into the teachings of Bove, because they 
solve the same problem of providing interactive TV with hyperlinked data in a media 
stream presented in a graphical overlay (Page 2, par. 1). 

As to dependent claim 30, Wink fails to teach a device as set forth in claim 28, 
wherein said detector (program), where as Bove does teach (Page 3, par. 4-5), Wink 
discloses an identifying feature being of further defined as detecting a predetermined 
symbol (E Page 3, fig. 1 ). It is obvious to one of ordinary skill in the art at the time of the 
invention to have used the teachings of Wink into the teachings of Bove, because they 
solve the same problem of providing interactive TV with hyperlinked data in a media 
stream presented in a graphical overlay (Page 2, par. 1). 

5. Claim 14 and 34 are rejected under 35 U.S.C. 103(a) as being unpatentable over 

Wink Communications (http://web.archive.orQ/web/20001206040800/wink.com/ ) in view of Murray et 

al (US 6,636,237 B1 ) in further view of Wink Communications (Alt. Site) 
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http://www.itvt.com/screenShotGallery/lntellocitv & Wink Communications/page 

1.html 

Note: that the referenced extra site corresponds to the same software, methods 
and teachings as disclosed in the above primary reference. It is obvious to one of 
ordinary skill in the art to have combined Wink into Wink, because they are the same 
product. 

As to dependent claim 14, Wink (Alt. Site) teaches a method as set forth in claim 
13 further including the step of displaying the object information in at least one of the 
layer, the player, and a window separate from the layer and the player, while the 
playback of the media stream is stopped (Fig.1; ESPN portal page is being displayed 
from the interaction of the user clicking on the ESPN today selectable region on the 
layer which is adjacent to the media stream of a hockey game.) 

As to dependent claim 34, Wink teaches a device as set forth in claim 31 , 
wherein said window is further defined as a window separate from said layer and said 
media stream (Fig.1 ; ESPN portal page is being displayed from the interaction of the 
user clicking on the ESPN today selectable region on the layer which is adjacent to the 
media stream of a hockey game.) 
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Conclusion 

• Swedlow,Tracy; Interactive TV Today - a division of jetPlanet; 

1/22/2001 ; http://www.itvt.com/etvwhitepaper.html ; talks about the 
past, present and future of Interactive TV. 

• Liang-Jie Zhang et al; A Per-object-granularity Tracking Mechanism 

for Interactive TV Viewership Estimation and Program Rating 2002; 
IEEE- 20021 1435/02; discloses a developer's kit for adding user 
selectable regions to a media stream and tracking movement of 
objects inside of the media stream. 

• IBM China Research Lab, IBM HotVideo, 1996; 

http://domino.research.ibm.com/comm/research people. nsf/pages/ 
zhanqli8.proiects.html 
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Inquires 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Nicholas M. Augustine whose telephone number is 571- 
272-1056. The examiner can normally be reached on Monday - Thursday: 7:30- 5:00. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Chanh Nguyen can be reached on 571-272-7772. The fax phone number 
for the organization where this application or proceeding is assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 
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